Skip to content

Add cache read details to LLM table#22

Merged
dbroeglin merged 1 commit into
mainfrom
dbroeglin-llm-table-details
Jun 27, 2026
Merged

Add cache read details to LLM table#22
dbroeglin merged 1 commit into
mainfrom
dbroeglin-llm-table-details

Conversation

@dbroeglin

Copy link
Copy Markdown
Owner

Copilot's OTel LLM-call table showed aggregate input tokens but did not surface cache reads when exporters provide them. This makes smoke-test economics harder to inspect across model families.

Summary

  • Parse per-call cache-read token attributes, including common aliases and nested token detail fields, into LlmCallSummary and turn/economic aggregates.
  • Expand the OTel LLM calls table with cache read, total tokens, wall time, and current/limit context columns.
  • Carry OTel cache-read totals into Pier metrics and documentation while preserving native shutdown totals as authoritative when available.

Testing

  • uv run ruff check --fix .
  • uv run ruff format .
  • uv run ruff check .
  • uv run pytest -q

Co-authored-by: Copilot <223556219+Copilot@users.noreply.github.com>
@dbroeglin dbroeglin merged commit 8c0273f into main Jun 27, 2026
7 checks passed
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment

Labels

None yet

Projects

None yet

Development

Successfully merging this pull request may close these issues.

1 participant